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Abstract 

We study the dynamics of correlation and variance in systems under the load of 
environmental factors. A universal effect in ensembles of similar systems under load 
of similar factors is described: in crisis, typically, even before obvious symptoms of 
crisis appear, correlation increases, and, at the same time, variance (and volatility) 
increases too. After the crisis achieves its bottom, it can develop into two directions: 
recovering (both correlations and variance decrease) or fatal catastrophe (correla- 
tions decrease, but variance not). This effect is supported by many experiments and 
observation of groups of humans, mice, trees, grassy plants, and on financial time 
series. A general approach to explanation of the effect through dynamics of adap- 
tation is developed. Different organization of interaction between factors (Liebig's 
versus synergistic systems) lead to different adaptation dynamics. This gives an ex- 
planation to qualitatively different dynamics of correlation under different types of 
load. 
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"Worse" 




Fig. 1. Correlations and variance in crisis. The typical picture: Cor |; Var | - stress; 
Cor 1; Var | - recovering; Cor [; Var | - approaching the dlsadaptation catastrophe after 
the bottom of the crisis. 

Introduction: Sources of Ideas and Data 



In many areas of practice, from physiology to economics, psychology, and engineering we 
have to analyze behavior of groups of many similar systems, which are adapting to the 
same or similar environment. Groups of humans in hard living conditions (Far North city, 
polar expedition, or a hospital, for example), trees under influence of anthropogenic air 
pollution, rats under poisoning, banks in financial crisis, enterprizes in recession, and many 
other situations of that type provide us with plenty of important problems, problems of 
diagnostics and prediction. 

For many such situations it was found that the correlations between individual systems 
are better indicators than the value of attributes. More specifically, in thousands of ex- 
periments it was shown that in crisis, typically, even before obvious symptoms of crisis 
appear, the correlations increase, and, at the same time, variance (volatility) increases 
too. After the crisis achieves its bottom, it can develop into two directions: recovering 
(both correlations and variance decrease) or fatal catastrophe (correlations decrease, but 
variance continue to increase) (Fig. [1]). 

Now, after 21 years of studying of this effect [T][2] . we maintain that it is universal for 
groups of similar systems that are sustaining a stress and have an adaptation ability. 
Hence, a theory of an adequate level of universality is needed. On the other hand, sit- 
uations with inverse behavior were predicted theoretically and found experimentally [3]. 
This makes the problem more intriguing. 

In this paper we attempt to answer to this challenge. First we review and analyze data 
for different kinds of systems: humans [2|^ll5ll6] . mice [7j, grassy plants [8], trees [9]. We 
perform also a case study of the thirty largest companies from the British stock market 
for the period 2006-2008. 

In economics, we use also published results of data analysis for equity markets of seven 
major countries over the period 1960-1990 ^lOj, for the twelve largest European equity 
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markets after the 1987 international equity market crash [TT], and for thirty companies 
from Deutsche Aktienindex (DAX) over the period 1988-1999 [I2]. Analysis of correlations 
is very important for portfolio optimization, and increase of correlations in crisis decreases 
the possibility of risk diversification ([H], Chs. 12, 13). In 1999, it was proposed [15] to 
use the distance dij = \J2{1 — pij), where pij is the correlation coefficient, for analysis 
of the hierarchical structure of a market. (This distance for multidimensional time series 
analysis was analyzed previously in Ref. p31-) The performance of this approach was 
demonstrated on the stocks used to compute the Dow Jones Industrial Average and on 
the portfolio of stocks used to compute the S&P 500 index. This approach was further 
developed and applied (together with more standard correlation analysis) for analysis of 
anatomy of the Black Monday crisis (October 19, 1987) [16]. In this analysis, hundreds of 
companies were used. 

Stock price changes of the largest 1000 U.S. companies were analyzed for the 2-year period 
1994-1995 [T7], and statistics of several largest eigenvalues of the correlation matrix was 
evidenced to be far from the random matrix prediction. This kind of analysis was continued 
for the three major US stock exchanges, namely, the New York Stock Exchange (NYSE), 
the American Stock Exchange (AMEX), and the National Association of Securities Dealers 
Automated Quotation (NASDAQ) ^18] . Cleaning of the correlation matrix by removing 
the part of the spectrum explainable by random matrix ensembles was proposed [TU] . 
Spectral properties of the correlation matrix were analyzed also for 206 stocks traded in 
Istanbul Stock Exchange Market during the 5- year period 2000-2005 [20j. 

Linear and nonlinear co-movements presented in the Real Exchange Rate (RER) in a 
group of 28 developed and developing countries were studied to clarify the important 
question about "crisis contagion" [2T]: Do strong correlations appear before crisis and 
provide crisis contagion, or do they grow stronger because of crisis? The spread of the 
credit crisis (2007-2008) was studied by referring to a correlation network of stocks in the 
S&P 500 and NASDAQ-100 indices. Current trends demonstrate that the losses in certain 
markets, follow a cascade or epidemic flow along the correlations of various stocks. But 
whether or not this idea of epidemic or cascade is a metaphor or a causal model for this 
crisis is not so obvious |22j . 

Most of the data, we collected by ourselves or found in publications, support the hypothesis 
presented in Fig. [TJ In all situations, the definitions of stress and crisis were constructed 
by experts in specific disciplines on the basis of specific knowledge. What do "better" and 
"worse" mean? This is a nontrivial special question and from the point of view of very 
practically oriented researchers the main outcome of modeling may be in the definition 
of crisis rather than in the explanation of details [23]. In many situations we can detect 
that one man's crisis is another man's road to prosperity. 

Nevertheless, all the experiments are unbiased in the following sense: the definitions of the 
"better-worse" scale were done before the correlation analysis and did not depend on the 
results of that analysis. Hence, one can state, that the expert evaluation of the stress and 
crisis can be (typically) reproduced by the formal analysis of correlations and variances. 
Moreover, this analysis may give the symptoms of the future changes, before an obvious 
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deterioration of the situation occur. 



The basic model of such generahty should include little detail, and we try to make it as 
simple as possible. We represent the systems, which are adapting to stress, as the systems 
which optimize distribution of available resource for neutralization of different aggressive 
factors (we consider deficit of anything needful as a negative factor too). These factor- 
resource models with optimization are very convenient for modeling of adaptation. We 
use a class of models many factors - one resource, but many nearest generalizations are 
absolutely clear (several resources, different models for the resource recovery, separation 
of the resource on a tactic resource and a strategic reserve, etc.). The crucial question 
is: what is the resource of adaptation^ This question arose for the first time when Selye 
published the concept of adaptation energy and experimental evidence supporting this idea 
[2HI25] . After that, this notion was significantly improved [26], plenty of indirect evidence 
supporting this concept were found, but this elusive adaptation energy is still a theoretical 
concept, and in the modern "Encyclopedia of Stress" we read: "As for adaptation energy, 
Selye was never able to measure it..." [27]. Nevertheless, the notion of adaptation energy 
is very useful in analysis of adaptation and is now in wide use (see, for example, [2SPU] ). 

The question about the nature of adaptation resource remains important for the eco- 
nomic situation too. The idea of exchange helps here: any resource could be exchanged 
for another one, and the only question is - what is the "exchange rate", how fast this 
exchange could be done, what is the margin, how the margin depends on the exchange 
time, and what is the limit of that exchange. Market economics is much closer to the idea 
of resource universalization than biophysics and medicine are. It is possible to include the 
exchange processes into models, but many questions appear immediately about unknown 
coefficients. In the zero approximation we can just postulate the universal adaptation re- 
source and hide all the exchange and recovering processes. For biophysics, this exchange 
idea seems also attractive, but of course there exist some limits of possible exchange 
of different resources. Nevertheless, we can follow the Selye arguments and postulate the 
adaptation energy under assumption that this is not an "energy" or Aristotle's "entelechy" 
(which definitely had an impact on Selye's work), but just a pool of various exchangeable 
resources. When an organism achieves the limits of resources exchangeability, the univer- 
sal non-specific stress and adaptation syndrome transforms (disintegrates) into specific 
diseases. Near this limit we have to expect the critical retardation of exchange processes. 

The idea of optimization is very natural for man-made systems in economics, but it re- 
quires usually some additional explanation in biophysics. The main source of the optimal- 
ity idea in biology is the formalization of natural selection and adaptive dynamics. After 
works of Haldane (1932) [30] and Gause (1934) [31] this direction, with various concepts 
of fitness optimization, was further developed (see, for example, review papers [32]|33|34] ). 
To transfer the evolutionary optimality principles to the short and long term adaptation 
we need the idea of genocopy-phenocopy inter changeability ([36], P- 117). The phenotype 
modifications simulate the optimal genotype, but in a narrower interval of change. We 
can expect that adaptation also gives the optimal phenotype, but the interval of the pos- 
sible changes should be even narrower, than for modifications. The idea of convergence 
of genetic and environmental effects was supported by analysis of genome regulation ^35] 



4 



(the principle of concentration-affinity equivalence). This gives a basis for the optimality 
assumption in adaptation modeling. 

To analyze adaptation by optimality of resource redistribution we have to answer one 
more question: how is the system of factors organized? For arbitrary interactions between 
factors and organism the modeling will give an answer with a high level of uncertainty. 
To construct a specific function, we need much more data than it is possible to have in 
such a general situation. Ecology already has a very attractive version for an answer. This 
is Liebigs Law of the Minimum. The principle behind this law is quite simple. Originally, 
it meant that the scarcest necessity an organism requires will be the limiting factor to 
its performance. A bit more generally, the worst factor determines the situation for an 
organism, and free resource should, perhaps, be assigned for neutralization of that factor 
(until it loses its leadership). The opposite principle of factor organization is synergy: the 
superlinear mutual amplification of factors. Adaptation to Liebig's system of factors, or 
to any synergistic system, leads to two paradoxes of adaptation: 

• Law of the Minimum paradox (Sec. 14. 2p : If for a randomly selected pair, (State of 
environment - State of organism), the Law of the Minimum is valid (everything is 
limited by the factor with the worst value) then, after adaptation, many factors (the 
maximally possible amount of them) are equally important. 

• Law of the Minimum inverse paradox (Sec. 14.31) : If for a randomly selected pair, (State of 
environment - State of organism), many factors are equally important and superlinearly 
amplify each other then, after adaptation, the smaller amount of factors is important 
(everything is limited by the factors with the worst non-compensated values, the system 
approaches the Law of the Minimum). 

Perhaps the most realistic model is a system of factors, which consists of several synergistic 
groups, while interaction between groups satisfies Liebig's Law. 

After introduction of the main ideas and data sources, we are in position to start more 
formal consideration. 



1 Indicators 

How can we measure correlations between various attributes in a population? If we have 
two variables, x and y, the answer is simple: we measure {xi,yi) for different individuals 
{i = 1, ...n, > 1 is the number of measurements) . The sample correlation coefficient (the 
Pearson coefficient) is 

{xy)-{x){y) 

where (...) stands for the sample average value: (x) = J^i^i- 

If individuals are characterized by more than two attributes = 1, ...m} then we have 
already m(m — l)/2 correlation coefficients between them, rjk. In biophysics, we usually 
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analyze correlations between attributes, and each individual organism is represented as a 
vector of attributes values. 



In econophysics, the standard situation is a "transposed" one: we study correlations be- 
tween objects, and data vectors correspond to the moments in time (with a possible 
extension to the variables taken with some delay). Each object (stock, enterprize, ...) is 
represented as a vector of values of a variable (asset return, for example) in a window of 
time. This is, essentially, just a difference between X and X^, where X is the matrix of 
data. 

In correlation analysis, this difference appears in two operations: centralization (when we 
subtract means in computation of covariance) and normalization (when we transform the 
covariance into the correlation coefficient). In one case, we centralize and normalize the 
columns of X: subtract average values in columns, and divide columns on their standard 
deviations. In another case, we apply these operations to the rows of X. For financial time 
series, the synchronous averages and variances ("varieties") and time averages and vari- 
ances ("volatilities") have different statistical properties. This was clearly demonstrated 
in a special case study [S7] . 

Nevertheless, such a difference does not appear very important for the analysis of the total 
level of correlations in crisis (just the magnitude of correlation changes, and correlations 
in time are uniformly less than synchronous ones, that is with agreement of observations 
from Ref. [37j). More details are presented in the special case study below. 

The sample correlation coefficient ([1]) can be used as an estimate of a "proper" correlation 
between random variables. But one can use the matrix of the sample correlations, its 
eigenvectors and eigenvalues as characteristics of linear connections in a finite dataset, 
without any probabilistic hypothesis, in the spirit of the classical Pearson work [SB] for 
example. Here we study the properties of finite datasets. 

To collect information about correlations between many attributes in one indicator, it is 
possible to use various approaches. Fist of all, we can evaluate the non-diagonal part of 
the correlation matrix in any norm, for example, in Lp norm 



If one would like to study strong correlations, then it may be better to delete terms with 
values below a threshold a > from this sum: 



This quantity Gp^a is a weight of the a- correlation graph. The vertices of this graph 
correspond to variables, and these vertices are connected by edges, if the absolute value 
of the correspondent sample correlation coefficient exceeds a: \rjk\ > a. In practice, the 
most used indicator is the weight G = Gi,o.5, which corresponds to p = 1 and a = 0.5. 




(2) 




(3) 
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Another group of indicators is produced from the principal components of the data. The 
principal components are eigenvectors of the covariance matrix and depend on the scales. 
Under normalization of scales to unit variance, we deal with the correlation matrix. Let 
Ai > A2 > ...Am > be eigenvalues of the correlation matrix. In this paper, we use 
the eigenvalues and eigenvectors of the correlation matrix. It is obvious that (A) = 1 and 
mP~^ > (A^) > 1 for p > 1, (A^) = 1 if all non-diagonal correlation coefficients are zero and 
(A^) = m'P"^ if all correlation coefficients are ±1. To select the dominant part of principal 
components, it is necessary to separate the "random" part from the "non-random" part 
of them. This separation was widely discussed (see, for example, the expository review 



The simplest decision gives Kaiser's significance rule: the significant eigenvalues are those, 
which are greater than the average value: Aj > (A). For the eigenvalues of the correlation 
matrix which we study here, it means Aj > 1. This rule works reasonable, when there are 
several eigenvalues significantly greater than one and others are smaller, but for a matrix 
which is close to a random matrix the performance may not be so good. In such cases 
this method overestimates the number of principal components. 

In econophysics, another simple criterion for selection of dominant eigenvalues became 
popular P0|18|19|l20] . Let us imagine that the dimension of the data vector m is large and 
the amount of data points n is also large, but their ratio q = n/m is not. This is the typical 
situation when we analyze data about thousands of stocks: in this case the time window 
could not be much larger than the dimension of data vector. Let us compare our analysis 
of real correlations to the fictitious correlations, which appear in m x n data matrices 
with independent, centralized, normalized and Gaussian matrix elements. If n — > 00 for 
given m then those fictitious correlations disappear, but if both m, n — > 00 for constant 
g > 1 then there exists the limit distribution of eigenvalues A with density 




Amin ^ A ^ Ajnaxi 



(4) 



A max / min 



If the amount of points is less than dimension of data, (g < 1) the same formula with 
substitution of g by 1/g is valid for distribution of non-zero eigenvalues. 

Instead of Kaiser's rule for dominant eigenvalues of the correlation matrix we get A, > A^ax 
with Amax given by Eq. (jlj). If g grows to 00, this new rule turns back into Kaiser's rule. 
If g is minimal (g = 1), then the proposed change of Kaiser's rule is maximal, Amax = 4 
and for dominant eigenvalues of the correlation matrix it should be Aj > 4. This new 
estimate is just an analogue of Kaiser's rule in the case when the amount of data vectors 
is compatible with the dimension of the data space, and, therefore, the data set is far 
from the law of large numbers conditions. 

Another popular criterion for selection of dominant eigenvalues gives the so-called broken 
stick model. Consider the closed interval J = [0,1]. Suppose J is partitioned into m 
subintervals by randomly selecting m — 1 points from a uniform distribution in the same 
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interval. Denote by 1^ the length of the k-th subinterval in the descending order. Then 
the expected value of Ik is 

Following the broken stick model, we have to include into the dominant part those eigen- 
values Afc (principal components), for which 

> E(/i) & > E(/2) & ... & > E(4) . (6) 



J2i Aj J2i Ai J2i Aj 

If the amount of datavectors n is less than the data dimension m, then m — n eigenvalues 
are zeros, and in Eqs. (I5l), (E]) one should take n subintervals instead of m ones. 

It is worth to mention that the trace of the correlation matrix is m, and the broken 
stick model transforms (for m > n) into Aj > Y7j=i^ (i = 1,...^). From the practical 
point of view, this method slightly underestimates the number of dominant eigenvalues. 
There are other methods based on the random matrices ensembles, but nobody knows 
the exact dimension of the empirical data, and the broken stick model works satisfactory 
and remains "the method of choice" . 

To compare the broken stick model to Kaiser's rule, let us mention that the first principal 
component is always significant due to Kaiser's rule (if there exists at least one nonzero 
correlation coefficient), but due to the broken stick model it should be sufficiently large: 
the inequality Ai > Z^jLi j should hold. In a high dimension m we can approximate the 
sum by the quadrature: Ai > Inm. 

If we have the dominant eigenvalues, Ai > A2 > > 0, I < m, then we can produce 
some other measures of the sample correlation: 

Et^; ;^Ea.- (7) 

j=i ^j+i ^ j=i 

Together with (A^) (p > 1, the usual choice is p = 2) this system of indicators can be used 
for analysis of empirical correlations. 

The choice of possible indicators is very rich, but happily, many case studies have shown 
that in analysis of adaptation the simplest weight G of the correlation graph performs 
well (better or not worse than all other indicators - see the case study below). The only 
adjustment which may slightly improve performance of the indicator, is optimization of 
selection of the threshold a. 



A similar observation was made in Ref. [16]. There the "asset tree" was studied, that is 
the recently introduced minimum spanning tree description of correlations between stocks. 
The mean of the normalized dynamic asset tree lengths was considered as a promising 
indicator of the market dynamics. It appeared that a simple average correlation coefficient 
gives the same signal in time, as a more sophisticated indicator, the mean of the normalized 
dynamic asset tree lengths, (compare Fig. 1 and Fig. 2 from Ref. [IS]). Especially we would 
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Fig. 2. Correlation graphs of lipid metabolism for newborn babies. Vertices correspond to 
different fractions of lipids, solid lines correspond to correlation coefficient between fractions 
\rij\ > 0.5, dashed lines correspond to 0.5 > \rij\ > 0.25. Upper row - Far North, lower row - 
the temperate belt of Siberia (the comfort zone). From the left to the right: lst-3rd days, 4th-6th 
days, 7th-10th days. 

like to attract attention to Fig. 12 from that paper, where very similar behavior of the 
mean correlation coefficient, the normalized tree length, and the risk of the minimum risk 
portfolio, as functions of time, was demonstrated. 

In many publications in econophysics the average correlation coefficient is used instead of 
sums of absolute values in Eq. ([3]). This is possible because in many financial applications 
the orientation of the scales is fixed and the difference between positive and negative 
correlations is very important, for example, for portfolio optimization. In a more general 
situation we have to use absolute values because we cannot coordinate a priori direction 
of different axes. 



2 Correlation and Risk in Physiology. Empirical Data 

In this section we represent some data which support our initial hypothesis (Fig. [1]). 
2. 1 Humans 

2.1.1 Lipid Metabolism: Newborn children, Far North Versus Temperate Belt 

We studied lipid metabolism for healthy newborn babies born in the temperate belt of 
Siberia (the comfort zone) and in the migrant families of the same ethnic origin in a 
Far North citjH. The blood analysis was taken in the morning, on an empty stomach, 
at the same time each day. All the data were collected during the summer. Eight lipid 
fractions were analyzed [T] . Resulting correlation graphs are presented in Fig. [2J Here solid 
lines represent the correlation coefficient \rij\ > 0.5, dashed lines represent correlation 
coefficient 0.5 > In J > 0.25. 



The parents lived there in the standard city conditions. 
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Fig. 3. Weight of the correlation graphs of activity of enzymes in leucocytes during urgent 
adaptation to the Far North conditions. The non-monotonic character of adaptation is clear 
(there are the "waves of adaptation" ) . 

2.1.2 Adaptation of Adults for Change of Climatic Zone 

Activity of enzymes in human leukocytes was studied [^TM2] . We analyzed the short-term 
adaptation (20 days) of groups of healthy 20-30 year old men who change their climate 
zone: 

• From the temperate belt of Siberia (Krasnoyarsk, comfort zone) to Far North in summer 
and in winter; 

• From Far North to the South resort (Sochi, Black Sea) in summer; 

• From the temperate belt of Russia to the South resort (Sochi, Black Sea) in summer. 

Results are represented in Figs. [3lHl This analysis supports the basic hypothesis and, on 
the other hand, could be used for prediction of the most dangerous periods in adaptation, 
which need special care. 

We selected the subgroup of people moved to Far North, that had any illness during the 
period of short-term adaptation. After 6 month at Far North, this group demonstrates 
much higher correlations between activity of enzymes in leucocytes than the main group: 
G = 5.81 versus G = 1.36 in the control group. 

2.1.3 Correlation Adaptometry at Work: Sport in Far North 

Presented data and dozens of other experiments ensured us that the effect is universal 
and it gives us a method to compare groups of people in various situations. This method 
received the name "Correlation adaptometry". An example of application of this method 
gives us the following problem. How sport interacts with ecological stress? More specifi- 
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Fig. 4. Weight of the correlation graphs of activity of enzymes in leucocytes during urgent 
adaptation at a resort. For people from Far North, the adaptation crisis occurs near the 15th 
day. 
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Fig. 5. Weight of the correlation graphs of activity of enzymes in leucocytes for schoolchildren 
(primary school). A - temperate belt of Siberia, B - Far North. 

cally, Dr. S.Y. Skobeleva and Prof. L.B. Zakharova (at the Institute for Medical Problems 
of Northern Regions, Krasnoyarsk) collected data about schoolchildren (primary school) 
from Far North and from the temperate belt of Siberia, who did sport intensively (swim- 
ming in swimming pools) and about a control group of schoolchildren, who did not work 
out intensively. Results are represented in Fig. [51 As a result it was concluded that the 
same intensity of the same sport could have the opposite effects on health (in perspective) 
in the temperate belt and in Far North. 




2.2 Destroying of Correlations "on the Other Side of Crisis 



It is very important to understand where the system is going: (i) to the bottom of the 
crisis with possibility to recover after that bottom, (ii) to the normal state, from the 
bottom, or (iii) to the "no return" point, after which it cannot recover. 

We studied this problem in many situation with analysis of fatal outcomes in oncological 
and other clinics. The main result is presented in Fig. [1) when approaching the no-return 
point, correlations destroy (G decreases), and variance typically does continues to increase 
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Fig. 6. Adaptation and disadaptation dynamics for mice after phenylhydrazine injection. 
03]. 

This effect was demonstrated also in special experiments. Acute hemolytic anemia caused 
by phenylhydrazine was studied in CBAxlac mice. After phenylhydrazine injections (60 
mg/kg, twice a day, with interval 12 hours) during first 5-6 days the amount of red cells 
decreased (Fig. [6]), but at the 7th and 8th days this amount increased because of spleen 
activity. After 8 days most of the mice died. Dynamics of correlation between hematocrit, 
reticulocytes, erythrocytes, and leukocytes in blood is presented in Fig. [61 Weight of the 
correlation graph increase precedeed the active adaptation response, but G decreased to 
zero before death (Fig. E]), while amount of red cells increased also at the last day. 

2. 3 Correlations and Health of Plants 

2.3.1 Scots Pines Near a Coal Power Station 

The effect (Fig. [T]) exists for plants too. The impact of emissions from a heat power 
station on Scots pine was studied [9j. For diagnostic purposes the secondary metabohtes 
of phenolic nature were used. They are much more stable than the primary products and 
hold the information about past impact of environment on the plant organism for longer 
time. 

The test group consisted of Scots pines (Pinus sylvestric L) in a 40 year old stand of 
the II class in the emission tongue 10 km from the power station. The station had been 
operating on brown coal for 45 years. The control group of Scots pines was from a stand of 
the same age and forest type, growing outside the industrial emission area. The needles for 
analysis were one year old from the shoots in the middle part of the crown. The samples 
were taken in spring in bud swelling period. Individual composition of the alcohol extract 
of needles was studied by high efficiency liquid chromatography. 26 individual phenolic 
compounds were identified for all samples and used in analysis. 

No reliable difference was found in the test group and control group average compositions. 
For example, the results for Proantocyanidin content (mg/g dry weight) were as follows: 

• Total 37.4±3.2 (test) versus 36.8±2.0 (control); 

• Free 8.1±0.7 (test) versus 8.0±2.0 (control); 

• Bound 29.3±3.2 (test) versus 28.7±1.9 (control). 
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Table 1 

Weight G of the correlation graph for different grassy plants under various trampling load 



Grassy Plant 


Group 1 


Group 2 


Group 3 


Lamiastrum 


1.4 


5.2 


6.2 


Paris (quadrifolia) 


4.1 


7.6 


14.8 


Convallaria 


5.4 


7.9 


10.1 


Anemone 


8.1 


12.5 


15.8 


Pulmonaria 


8.8 


11.9 


15.1 


Asarum 


10.3 


15.4 


19.5 



Nevertheless, the variance of compositions of individual compounds in the test group was 
significantly higher, and the difference in correlations was huge: G = 17.29 for the test 
group versus G = 3.79 in the control group. 

2.3.2 Grassy Plants Under Trampling Load 

The grassy plants in oak tree-plants are studied. For analysis the fragments of forests are 
selected, where the densities of trees and bushes were the same. The difference between 
those fragments was in damaging of the soil surface by trampling. Tree groups of fragments 
are studied: 

• Group 1 - no fully destroyed soil surface; 

• Group 2 - 25% of soil surface are destroyed by trampling; 

• Group 3 - 70% of soil surface are destroyed by trampling. 

The studied physiological attributes were: the height of sprouts, the length of roots, the 
diameter of roots, the amount of roots, the area of leafs, the area of roots. Results are 
presented in Table [H 



3 Correlations and Risk in Economics. Empirical Data 

3.1 Thirty Companies from the FTSE 100 Index. A Case Study 
3.1.1 Data and Indicators 

For the analysis of correlations in financial systems we used the daily closing values over 
the time period 03.01.2006 - 20.11.2008 for companies that are registered in the FTSE 100 
index (Financial Times Stock Exchange Index). The FTSE 100 is a market-capitalization 
weighted index representing the performance of the 100 largest UK-domiciled blue chip 
companies which pass screening for size and liquidity. The index represents approximately 
88.03% of the UKs market capitalization. FTSE 100 constituents are all traded on the 
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Fig. 7. Scatter diagrams for three pairs of indicators: G — \\r\\i, G — ||r||2, and G— Dim, where 
Dim is amount of principal components estimated due to the broken stick model. 



London Stock Exchanges SETS trading system. We selected 30 companies that had the 
highest value of the capital (on the 1st of January 2007) and stand for different types of 
business as well. The list of the companies and business types is displayed in Table El 

Data for these companies are available form the YahoolFinance web-site. For data clean- 
ing we use also information for the selected period available at the London Stock Ex- 
change web-site. Let Xi{t) denote the closing stock price for the zth company at the 
moment t, where i = 1, 30, t = 1, 732. We analyze the correlations of logarithmic returns: 
x\{t) = In ^ = 2, 732 in sliding time windows of length p = 20, this corresponds ap- 

proximately to 4 weeks of 5 trading days, t = p + 1, 732. The correlation coefficients rij{t) 
and all indicators for time moment t are calculated in the time window [t—p,t—l], which 
precedees t. This is important if we would like to consider changes in these indicators as 
precursors of crisis. 

The information about the level of correlations could be represented in several ways. Here 
we compare 4 indicators: 

• The non-diagonal part of the correlation matrix in L2 norm - ||r||2; 

• The non-diagonal part of the correlation matrix in Li norm - ||r||i; 

• The sum of the strongest elements G = J2j>i.\r,j\>o.5 kyh 

• The amount Dim of principal components estimated due to the broken stick model. 

Dynamics of the first three indicators are quite similar. Scatter diagrams (Fig. [7]) demon- 
strate strong connection between the indicators. We used the weight of the correlation 
graph G (the sum of the strongest correlations Vij > 0.5, i 7^ j) for our further analysis. 

Fig. [8] allows us to compare dynamics of correlation, dimension and variance to the value 
of FTSEIOO. Correlations increase when the market goes down and decrease when it 
recovers. Dynamics of variance of log-returns has the same tendency. To analyze the 
critical periods in more detail, let us select several time intervals and several positions of 
the sliding window inside these intervals. 
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Table 2 

Thirty largest companies for analysis from the FTSE 100 index 



Number 


Business type 


Company 


Abbreviation 


1 


Mining 


Anglo American pic 


AAL 


2 




BHP Billiton 


BHP 


3 


Energy (oil/gas) 


BG Group 


BG 


4 




BP 


BP 


5 




Royal Dutch Shell 


RDSB 


6 


Energy (distribution) 


Centrica 


CNA 


7 




National Grid 


NG 


8 


Finance (bank) 


Barclays pic 


BARC 


9 




HBOS 


HBOS 


10 




HSBC HLDG 


HSBC 


11 




Lloyds 


LLOY 


12 


Finance (insurance) 


Admiral 


ADM 


13 




Aviva 


AV 


14 




LandSecurities 


LAND 


15 




Prudential 


PRU 


16 




Standard Chartered 


STAN 


17 


Food i")roductJou 


U)iil(nx'r 


ULVR 


18 


Consumer 


Diageo 


DGE 


19 


goods /food/ drinks 


SABMiller 


SAB 


20 




TESCO 


TSCO 


21 


Tobacco 


British American Tobacco 


BATS 


22 




Imperial Tobacco 


IMT 


23 


Pharmaceuticals 


AstraZeneca 


AZN 


24 


(inc. research) 


GlaxoSmithKline 


GSK 


25 


Telecommunications 


BT Group 


BTA 


26 




Vodafone 


VOD 


27 


Travel/leasure 


Compass Group 


CPG 


28 


Media (broadcasting) 


British Sky Broadcasting 


BSY 


29 


Aerospace/ 


BAE System 


BA 


30 


defence 


Rolls-Royce 


RR 
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Fig. 8. Dynamics of FTSE index, G, Variance, and Dimension estimated due to the broken stick 
model. 



3.1.2 Correlation Graphs for Companies 

We extracted 2 intervals for more detailed analysis. The first interval, 10/04/2006 - 
21/07/2006, represents the FTSE index decrease and restoration in spring and sum- 
mer 2006. The second interval, 02/06/2008 - 04/11/2008, is a part of the financial cri- 
sis. In each interval we selected six points and analyzed the structure of correlations 
for each of these points (for a time window, which precedes this point). For each se- 
lected point, we create a correlation graph, solid lines represent correlation coefficient 
\rij\ > a/0.5 (VO.5 = cos(7r/4) ^ 0.707), dashed lines represent correlation coefficient 
v^03 > \rij\ > 0.5: (Figs. [9t;,d, [TOb.d). On these correlation graphs it is easy to observe, 
how critical correlations appear, how are they distributed between different sectors of 
economics, and how the crisis moves from one sector to another. 

There is no symmetry between the periods of the FTSE index decrease and recovering. 
For example, in Fig. [9t we see that at the beginning (falling down) the correlations inside 
the financial sector are important and some correlations inside industry are also high, but 
in the corresponding recovering period (Fig. [9li) the correlations between industry and 
financial institutions become more important. 

All the indicators demonstrate the most interesting behavior at the end of 2008 (Fig. [8l). 
The grows of variance in the last peak is extremely high, but the increase of correlations 
is rather modest. If we follow the logic of the basic hypothesis (Fig. [1]), then we should 
suspect that the system is going to "the other side of crisis", not to recovery, but to 
disadaptation, this may be the most dangerous symptom. 
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Fig. 9. Correlation graphs for six positions of sliding time window on interval 10/04/2006 - 
21/07/2006. a) Dynamics of FTSEIOO (dashed line) and of G (solid line) over the interval, verti- 
cal lines correspond to the points that were used for the correlation graphs, b) Thirty companies 
for analysis and their distributions over various sectors of economics, c) The correlation graphs 
for the first three points, FTSEIOO decreases, the correlation graph becomes more connective, 
d) The correlation graphs for the last three points, FTSEIOO increases, the correlation graph 
becomes less connective. 



3.1.3 Graphs for Gorrelations in Time 



The vector of attributes that represents a company is a 20 day fragment of the time series. 
In standard biophysical research, we studied correlations between attributes of an individ- 
ual, and rarely, correlation between individuals for different attributes. In econophysics 
the standard situation is opposite. Correlation in time is evidenced to be less than cor- 
relation between companies [37j. Nevertheless, correlation between days in a given time 
window may be a good indicator of crisis. 

Let us use here Gt for the weight of the correlation graph in time. Because correlation in 
time is less than between stocks, we select here another threshold: Gt is the sum of the 
correlation coefficients with absolute value greater then 0.25, Dynamics FTSE together 
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03/06/2008 30/06/2008 11/07/2008 




14/08/2008 12/09/2008 14/10/2008 
d) 0.5<|rJ<0.7 |rj>0.7 

Fig. 10. Correlation graphs for six positions of sliding time window on interval 02/06/2008 - 
04/11/2008. a) Dynamics of FTSEIOO (dashed line) and of G (solid line) over the interval, verti- 
cal lines correspond to the points that were used for the correlation graphs, b) Thirty companies 
for analysis and their distributions over various sectors of economics, c) The correlation graphs 
for the first three points, FTSEIOO decreases, the correlation graph becomes more connective. 
Between the third and the 4th points FTSEIOO increased, and the first graph here is more rar- 
efied than at the third point. Between the third and the 4th points FTSEIOO slightly increased, 
correlation decreased, and the first graph at the next row is more rarefied than at the third 
point, d) The correlation graphs for the last three points, FTSEIOO decreases, the correlation 
graph becomes more connective. 

with values of Gt are presented in Fig. [TTl Solid lines represent correlation coefficient 
> 0.5, dashed lines represent correlation coefficient 0.5 > |rjj| > 0.25. 

On the figures [12], [13] we combined graphs of days correlations - 20 trading days prior to 
the selected days. 

Analysis of dynamics of Gt allows us to formulate a hypothesis: typically, after the increase 
of Gt the decrease of FTSEIOO index follows (and, the decrease of Gt preseeds the increase 
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Fig. 11. Dynamics of the market Xftse, weight of correlation Gt the sum of the correlation 
coefficients with absolute value greater then 0.25, Variance (volatility), and dimension of the 
correlation matrix estimated due to the broken stick model. 

of FTSEIOO). The time delay is approximately two working weeks. In that sense, the 
correlation in time seems to be better indicator of the future change than the correlation 
between stocks which has not such a time gap. On the other hand, the amplitude of change 
of Gt is much smaller, and some of decreases of FTSEIOO index could not be predicted 
by increases of Gt (Fig. fTTl) . 

These observations are still preliminary and need future analysis for different financial 
time series. 



Strong correlation between days appears also with some time gap: the links emerge not 
obligatory between nearest days, but mostly with interval 4-15 days (see Figs. [121 fT3l) . 



3.2 Correlations and Crisis in Financial Time Series 



In economics and finance, the correlation matrix is very important for the practical prob- 
lem of portfolio optimization and minimization of risk. Hence, an important problem 
arises: are correlations constant or not? The hypothesis about constant correlations was 
tested for monthly excess returns for seven countries (Germany, France, UK, Sweden, 
Japan, Canada, and US) over the period 1960-90 [10]. Correlation matrices were calcu- 
lated over a sliding window of five years. The inclusion of October 1987 in the window led 
to increase of correlation in that window. After analysis of correlations in six periods of 
five years the null hypothesis of a constant correlation matrix was rejected. In addition, 
the conditional correlation matrix was studied. The multivariate process for asset return 
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Fig. 12. Graphs for correlation in time for six positions of sliding time window on inter- 
val 10/04/2006 - 21/07/2006. a) Dynamics of FTSEIOO (dashed line), G (solid line) and Gt 
(dash-and-dot line) over the interval, vertical lines correspond to the points that were used for 
the correlation graphs, b) The correlation graphs for the first three points: FTSEIOO decreases 
and the correlation graph becomes more connective, c) The correlation graphs for the last three 
points: FTSEIOO increases and the correlation graph becomes less connective. 

was presented as 

Rt = mt.i + et; rrit^^ = E{Rt\Ft_i) , (8) 

where Rt is a vector of asset returns and rrit-i is the vector of expected returns at time t 
conditioned on the information set Ft-i from the previous step. Vector et is the unexpected 
(unpredicted) component in the asset returns. Correlations between its components are 
called conditional correlations. It was demonstrated that these conditional correlations 
are also not constant. Two types of change were found. Firstly, the correlations have 
statistically significant time trend and grow in time. The average increase in correlation 
over 30 years is 0.36. Secondly, correlations in periods of high volatility (high variance) 
are higher. To obtain this result, the following model for the correlation coefficient was 
identified: 



I, us i,US 

r' = rn 



(9) 



where rj'"*^ is the correlation coefficient between the unexpected (unpredicted) components 
in the asset returns for the ith country and the US, 5"* is a dummy variable that takes the 
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Fig. 13. Correlation graphs for six positions of sliding time window on interval 02/06/2008 
- 04/11/2008. a) Dynamics of FTSEIOO (dashed hne), G (solid line) and Gt (dash-and-dot 
line) over the interval, vertical lines correspond to the points that were used for the correlation 
graphs, b) Thirty companies for analysis and their distributions over various sectors of economics, 
c) The correlation graphs for the first three points: FTSEIOO decreases and the correlation graph 
becomes more connective. Between the third and the 4th points FTSEIOO increases, and the 
first graph here is more rarefied than at the third point. Between the third and the 4th points 
FTSEIOO slightly increases, correlation decreased, and the first graph at the next row is more 
rarefied than at the third point, d) The correlation graphs for the last three points: FTSEIOO 
decreases and the correlation graph becomes more connective. 

value 1 if the estimated conditional variance of the US market for time t is greater than 
its unconditional (mean) value and otherwise. The estimated coefficient ri is positive 
for all countries. The average over all countries for ro is equal to 0.430, while the average 
turbulence effect ri is 0.117 [lO]. Finally, it was demonstrated that other informational 
variables can explain more changes in correlations than just the "high volatility - low 
volatility" binning. 

To analyze correlations between European equity markets before and after October 1987, 
three 76-month periods were compared: February 1975-May 1981, June 1981-September 
1987, and November 1987-February 1994 [llj. The average correlation coefficient for 13 
equity markets (Europe + US) increased from 0.37 in June 1981-September 1987 to 0.5 in 
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November 1987-February 1994. The amount of significant principal components selected 
by Kaiser's rule decreases from 3 (in both periods before October 1987) to 2 (in the 
period after October 1987) for all markets and even from 3 to 1 for 12 European markets 
[llj. Of course, in average values for so long periods it is impossible to distinguish the 
consequences of the October 1987 catastrophe and a trend of correlation coefficients (that 
is, presumably, nonlinear). 

Non-stationarity of the correlation matrix was demonstrated in a detailed study of the 
financial empirical correlation matrix of the 30 companies which Deutsche Aktienindex 
(DAX) comprised during the period 1988-1999 [12j. The time interval (time window) 
is set to 30 and continuously moved over the whole period. It was evidenced that the 
drawups and the drawdowns of the global index (DAX) are governed, respectively, by 
dynamics of significantly distinct nature. The drawdowns are dominated by one strongly 
collective eigenstate with a large eigenvalue. The opposite applies to drawups: the largest 
eigenvalue moves down which is compensated by a simultaneous elevation of lower eigen- 
values. Distribution of correlation coefficients for these data have a distinctive bell-like 
shape both for one time window (inside one correlation matrix) and for ensemble of such 
sliding windows in a long time period. 

This observation supports the idea of applying the theory of the Gaussian matrix ensem- 
bles to analysis of financial time series. The random matrix theory gives a framework for 
analysis of the cross-correlation matrix for multidimensional time series. In that frame- 
work, stock price changes of the largest 1000 U.S. companies were analyzed for the 2-year 
period 1994-1995 [17], and statistics of several largest eigenvalues was evidenced to be 
far from the random matrix prediction, but the distribution of "the rest" of eigenvalues 
and eigenvectors satisfies the random matrix ensemble. The crucial question is: where is 
the border between the random and the non-random parts of spectra? Formula (jl]) gives 
in this case Amax ~ 2. The random matrix theory predicts for the Gaussian orthogonal 
ensembles that the components of the normalized eigenvectors are distributed according 
to a Gaussian probability distribution with mean zero and variance one. Eigenvectors 
corresponding to most eigenvalues in the "bulk" (A < 2) have the Gaussian distribution, 
but eigenvectors with bigger eigenvalues significantly deviate from this. |17j . 

This kind of analysis was continued for the three major US stock exchanges, namely 
the New York Stock Exchange (NYSE), the American Stock Exchange (AMEX), and 
the National Association of Securities Dealers Automated Quotation (NASDAQ) |18j . 
The concept of "deviating eigenvectors" was developed, these vectors correspond to the 
eigenvalues which are systematically outside the random matrices ensembles predictions. 
Analysis of "deviating eigenvectors" which are outside the random matrices ensembles 
predictions (jl]) gives information of major factors common to all stocks, or to large business 
sectors. The largest eigenvalue was identified as the "market mode". During periods of 
high market volatility values of the largest eigenvalue are large. This fact was commented 
as a strong collective behavior in regimes of high volatility. For the largest eigenvalue, the 
distribution of coordinates of the eigenvector has very remarkable properties: 

• It is much more uniform than the prediction of the random matrix theory (authors of 
Ref. [18] described this vector as "approximately uniform", suggesting that all stocks 



22 



participate in this "market mode"); 

• Almost all components of that eigenvector have the same sign. 

• A large degree of cross correlations between stocks can be attributed to the influence 
of the largest eigenvalue and its corresponding eigenvector 

Two interpretations of this eigenvector were proposed: it corresponds either to the common 
strong factor that affects all stocks, or it represents the "collective response" of the entire 
market to stimuli. 

Spectral properties of the correlation matrix were analyzed also for 206 stocks traded 
in Istanbul Stock Exchange Market during the 5- year period 2000-2005 [20] . One of the 
main results of this research is the observation that the correlations among stocks are 
mostly positive and tend to increase during crises. The number of significant eigenvalues 
(outside the random matrix interval) is smaller than it was found in previous study of 
the well-developed international market in the US. The possible interpretation is: the 
emerging market is ruling by smaller amount of factors. 

Increase of correlations in crisis time was demonstrated by analysis of 150 years of market 
dynamics [S]. As a result, in the year 2004 it was mentioned very optimistically: "Our 
tests suggest that the structure of global correlations shifts considerably through time. 
It is currently near an historical high - approaching levels of correlation last experienced 
during the Great Depression" . Nevertheless, it remains unclear, does the correlation cause 
the transmission chain of collapse or is it inextricably tied to it [22] ? 

There are several types of explanation of these correlation effects. One can look for the 
specific reasons in the balance between specialization and globalization, in specific fiscal, 
monetary, legal, cultural or even language conditions, in dynamics of fundamental eco- 
nomic variables such as interest rates and dividend yields, in the portfolio optimization 
by investors, and in many similar more or less important processes. These specific expla- 
nations could work, but for the effect of such a generality it is desirable to find a theory 
of compatible generality. Now we can mention three sources for such a theory: 

(1) Theory of individual adaptation of similar individuals to a similar system of factors; 

(2) Theory of interaction: information interaction, co-ordination, or deeper integration; 

(3) Theory of collective effects in market dynamics. 

The first approach (supported by biological data) is a sort of mean-field theory: everybody 
is adapting to a field of common factors, and altogether change the state of that system. 
There are two types of argumentation here: similarity of factors, or similarity of adaptation 
mechanisms (or both): 

• In the period of crisis there appear the same challenges for most of the market partic- 
ipants, and correlation increases because they have to answer the same challenge and 
struggle with the same factors. 

• In the period of crisis all participants are under pressure. The nature of that pres- 
sure may be different, but the mobilization mechanisms are mostly universal. Similar 
attempts of adaptation produce correlation as a consequence of crisis. 
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This theory is focused on the adaptation process, but may be included into any theory of 
economical dynamic as an adaptation feedback. We study the adaptation of individuals 
in the "mean field" , and consider dynamics of this field as external conditions. 

The interaction theory may be much more reach (and complicated). For example, it can 
consider such an effect of behavior in crisis: there is a lack of information and of known 
optimal solutions, therefore, different agents try to find clues to rational behavior in the 
behavior of other agents, and the correlation increase. Coordination in management and 
in financial politics is the obvious effect of interaction too, and we can observe also a 
deeper integration, which causes fluxes of moneys and goods. 

Collective effects in market dynamics may also generate correlations and, on the other 
hand, can interact with correlations which appear by any specific or nonspecific reasons. 
For example, high levels of correlation often lead to the loss of dissipation in dynamics 
and may cause instability. 

Further in this work, we focus on the theory of individual adaptation of similar individuals 
to a similar system of factors. We accept the hypothesis that this component is common 
for ecological physiology of adaptation to hard living conditions, and for economics in 
crisis. This theory does not pretend to explain all possible reasons for correlation in crisis. 
Other effects may be important, and could be incorporated later, if necessary. 



4 Theoretical approaches 

4-1 The "Energy of Adaptation" and Factors- Resources Models 
4.1.1 Factors and Systems 

We start from a very simple abstract that is close to the usual factor analysis. We consider 
several systems that are under influence of several factors Fi,...Fq. Each factor has its 
intensity {i = l,...q). For convenience, we consider all these factors as negative or 
harmful (later, after we introduce fitness W, it will mean that all partial derivatives are 
non-positive dW/dfi < 0). This is just a convention about choice of axes directions: a 
wholesome factor is just a "minus harmful" factor. 

Each system has its adaptation systems, a "shield" that can decrease the infiuence of 
these factors. In the simplest case, it means that each system has an available adaptation 
resource, R, which can be distributed for neutralization of factors: instead of factor in- 
tensities fi the system is under pressure from factor values — a^ri (where a, > is the 
coefficient of efficiency of factor Fi neutralization by the adaptation system and rj is the 
share of the adaptation resource assigned for the neutralization of factor Fi, J^i^^i ^ R)- 
The zero value fi — aiVi = is optimal (the fully compensated factor), and the further 
compensation is impossible and senseless. 
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Interaction of each system with a factor Fi is described by two quantities: the factor Fi 
pressure ipi = fi — a^Vi and the resource assigned to the factor F^ neutrahzation. The first 
quantity characterizes, how big the uncompensated harm is from that factor, the second 
quantity measures, how intensive is the adaptation answer to the factor (or how far the 
system was modified to answer the factor Fi pressure). 

The question about interaction of various factors is very important, but, first of all, let 
us study the one-factor models. 

4.1.2 One-Factor Model 

4.1.2.1 Tension-Driven Models. In these models, observable properties of interest 
Xk {k = 1, ...m) can be modeled as functions of factor pressure ip plus some noise efc. 

Let us consider one-factor systems and linear functions (the simplest case). For the 



where /ifc is the mean value of Xk for fully compensated factor, 1^ is a coefficient, ip = 
f — avf, and rf < R is amount of available resource assigned for the factor neutralization. 
The values of /i^ could be considered as "normal" (in the sense opposite to "pathology"), 
and noise ek reflects variability of norm. 

If systems compensate as much of factor value, as it is possible, then Vf = min{i?, //a}, 
and we can write: 



Individual systems may be different by the value of factor intensity (the local intensity 
variability), by amount of available resource R and, of course, by the random values of 
ek- If all systems have enough resource for the factor neutralization (ar > /) then all the 
difference between them is in the noise variables e^. 

If the factor value increases, and for some of the systems the factor intensity / exceeds 
the available compensation aR then for these systems ijj > and the term Ikip in Eq. flTUl) 
becomes important. If the noise of the norm ek is independent of ijj then the correlation 
between different Xk increases monotonically with /. 

With increase of the factor intensity / the dominant eigenvector of the correlation matrix 
between Xk becomes more uniform in the coordinates, which tend asymptotically to 

Correlation between systems also increases (just transpose the data matrix), and coordi- 
nates of the dominant eigenvector similarly tend to values (which are positive), but 
this tendency has character of a "wave of the resource exhausting" which spreads through 
the systems following the rule (fTTI) . 



Xk = IJ'k + h-ip + Cfc , 



(10) 




(11) 
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The observation of Ref. [18] partially supports the uniformity of the eigenvector that cor- 
responds to the largest eigenvalue which "represents the influence of the entire market that 
is common to all stocks." Fig. 8d from Ref. [18j shows that the components of this eigen- 
vector are positive and "almost all stocks participate in the largest eigenvector." Also, in 
Ref. [12] it was demonstrated that in the periods of drawdowns of the global index (DAX) 
there appears one strongly dominant eigenvalue for synchronous correlations between 30 
companies from DAX. Similar results for 30 British companies are presented in Figs. [11], 
[HI In physiology, we also found these "maximum integration" effects for various loads on 
organisms. When the pressure is lower then, instead of one dominant eigenvector which 
represents all functional systems of an organism, there appears a group of eigenvectors 
with relatively high eigenvalues. Each of these vectors has significant components for at- 
tributes of a specific group of functional systems, and the intersection of those groups 
for different eigenvectors is not large. In addition, the effect of factors "disintegration" 
because of overload was also observed. 



4.1.2.2 Response— Driven Models. What is more important for values of the ob- 
servable quantities Xk'- the current pressure of the factors, or the adaptation to this factor 
which modified some of parameters? Perhaps, both, but let us introduce now the second 
simplest model. 

In the response-driven model of adaptation, the quantities Xk are modeled as functions 
of adaptive response arj plus some noise e^: 

Xk = l^k + Qkarf + ek . (12) 

When / increases then, after threshold / = aR, the term Ikarj transforms into IkaR and 
does not change further. The observable quantities Xk are not sensitive to changes in the 
factor intensity / when / is sufficiently large. This is the significant difference from the 
behavior of the tension-driven model (llOp . which is not sensitive to change of / when / 
is sufficiently small. 



4.1.2.3 Tension— and— Response Driven 2D One— Factor Models. This model 
is just a linear combination of Eqs. (fTOj) and (fT2|) 

Xk= fJ'k + hi' + Qkarj + . (13) 

For small / (comfort zone) = 0, the term hip vanishes, arj = f and the model has 
the form x^ = fik + Qkf + Cfc- For intermediate level of /, if systems with both signs of 
inequality / ^ aR are present, the model imitates 2D (two-factor) behavior. After the 
threshold / > aR is passed for all systems, the model demonstrates ID behavior again: 
Xk = fJ'k + hf + {% — lk)o.R + ek ■ For small / the motion under change of / goes along 
direction qk, for large / it goes along direction Ik- 



26 



4.1.2.4 Remark About One-Factor Econometrics Time Series Models. In 

this Sec, we consider models with adaptation to the pressure of one factor. It is neces- 
sary to distinguish these models from the classical one-factor econometrics models which 
assume that the returns of stocks (p,) are controlled by one factor, the "market" return 
M(t). In this model, for any stock 

Pi{t) = ai + hM{t) + ei{t) (14) 

where pi{t) is the return of the zth stock at time t, a, and hi are real parameters, and ej(t) 
is a zero mean noise. In our models, the factor pressure characterizes the time window and 
is slower variable than the return. Return values at different time moments are attributes 
{xk)i the vector of these parameters characterizes a system, and k stands for time moment. 
Let us compare this model to Eq. (fTOj) . We find that hi stands for tp value for an individual 
(ith) system and vector of market values M{t) in a given time window plays role of vector 
Ik from Eq. (fTOl) . Factor pressure is not constant in time and is just approximate constant 
in the time window. This makes the considered class of adaptation models significantly 
wider than the simplest one-factor econometrics models with constant coefficients hi f[T^ . 
Instead of Eq. (IT^ we have 

Pi{t) = ai + ^i{t)M{t)+ei{t) , (15) 
where we collect local differences in coefficients hi. 

im = hA (16) 

I 0, else. 

In according to the initial model of adaptation, there is local difference between individuals 
in factor values, / = fo(t) + fi(t), but such a model includes too many parameters, and we 
propose Eq. (fT6!) as a compromise. Already this oversimplified one-factor approximation 
differs from the original model (fT^ . Coefficient ipiit) depends on t, and increases in 
time of breakdowns together with its variance. This increase could explain difference 
between the simplest realization of econometrics models 0141) and real time series, which 
was described in Ref. |37] (at least, it describes qualitatively local explosions of variability 
and of correlations between stocks in the crisis time). 



4- 1.3 How to Merge Factors? 

Formally, for q factors one can generalize the one-factor tension-driven model ffTOl) in the 
form. 

Xk = Xk{^l,^2,--^q)+(^k- (17) 

In this equation, the compensated values of factors, ipi = fi used and ^^=1 < R- 

Two questions appear immediately: (i) how to find the distribution of resource, assigned 
for neutralization of different factors, and (ii) how to represent the functions Xfc(V'i, •••^g)- 
Usually, in factor analysis and in physics both, we start from assumption of linearity 
("in the first approximation"), but this approximation does not work here properly. In 
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the simplest but reasonable approximation, max-min operations appear instead of linear 
operations. This sounds very modern [15] and even a bit extravagant, but it was discovered 
many years ago by Justus von Liebig (1840). His "law of the minimum" states that 
growth is controlled by the scarcest resource (limiting factor) [IB]. This concept was 
originally applied to plant or crop growth. Many times it was criticized, rejected, and 
then returned and demonstrated quantitative agreement with experiments |16], [17], [H]. 
Liebig's Law of the minimum was extended to more a general conception of factors, not 
only for elementary physical description of available chemical substances and energy. Any 
environmental factor essential for life that is below the critical minimum, or that exceeds 
the maximum tolerable level could be considered as a limiting one. 

The biological generalizations of Liebig's Law were supported by the biochemical idea 
of limiting reaction steps (modern theory of limiting steps and dominant systems for 
multiscale reaction networks is presented in recent review [19]). Some of generalizations 
went quite far from the agriculture and ecology. The law of the minimum was applied to 
economics [SO] and to education, for example [5T]. 

In according to Liebig's Law, the linear tension-driven model is 

Xk = fik + h + Gk ■ (18) 

The form of the response-driven model depends on the factor intensities: 

Xk = fJ'k + Yl bkittiri + ek . (19) 

i=l 

Analogously, the tension-and-response driven model reads: 

q 

Xk= fJ'k + h max{?/^i} + V bkittiVi + ek . (20) 

l<i<q — ; 



4-1-4 Optimality and Fitness 

Adaptation optimizes the state of the system for a given amount of available resource. 
This idea seems very natural, but it may be a difficult task to find the objective function 
that is hidden behind the adaptation process. Nevertheless, even an assumption about 
existence of an objective functions and about its general properties helps in analysis of 
adaptation process. 

Assume that adaptation should maximize an objective function W which depends on the 
compensated values of factors, ipi = fi ~ CLi'>^i ioi the given amount of available resource: 

W{fi-airij2-a2r2,--fq-aqrq) ^ max ; 

(21) 

ri > 0, /i - aiVi > 0, ELi ri<R. 

The only question is: why can we be sure that adaptation follows any optimality principle? 
Existence of optimality is proven for microevolution processes and ecological succession. 
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The mathematical backgrounds for the notion of "natural selection" in these situations are 
well-established after works of Haldane (1932) [30] and Gause (1934) [31]. Now this direc- 
tion with various concepts of fitness (or "generalized fitness" ) optimization is elaborated 
in many details (see, for example, review papers [^33f34j ). 

The foundation of optimization is not so clear for such processes as modifications of 
phenotype, and for adaptation in various time scales. The idea of genocopy-phenocopy 
interchangeability was formulated long ago by biologists to explain many experimental ef- 
fects: the phenotype modifications simulate the optimal genotype ([3S], P- 117). The idea 
of convergence of genetic and environmental effects was supported by analysis of genome 
regulation [35| (the principle of concentration-affinity equivalence). The phenotype mod- 
ifications produce the the same change, as evolution of genotype does, but faster and in 
smaller range of conditions (the proper evolution can go further, but slower). It is natural 
to assume that adaptation in different time scales also follows the same direction, as evo- 
lution and phenotype modifications, but faster and for smaller changes. This hypothesis 
could be supported by many biological data and plausible reasoning. 

For man-made systems (social and economical ones) the idea of optimality is very natural 
if we keep in mind that "optimal" does not mean "perfect" and is always subject to the 
choice of objective functional and conditions. 

It seems productive to accept the idea of optimality and to use it as far, as this will not 
contradict the data. 



4-2 Law of the Minimum Paradox 

Liebig used the image of a barrel - now called Liebig's barrel - to explain his law. Just 
as the capacity of a barrel with staves of unequal length is limited by the shortest stave, 
so a plant's growth is limited by the nutrient in shortest supply. 

Adaptation system acts as a cooper and repairs the shortest stave to improve the barrel 
capacity. 

Indeed, in well-adapted systems the limiting factor should be compensated as far as this 
is possible. It seems obvious because of very natural idea of optimality, but arguments of 
this type in biology should be considered with care. 

Assume that adaptation should maximize a objective function W ( 1211) which satisfies 
Liebig's Law: 

W = W (max{/, - a,r,}) ; < (22) 

under conditions > 0, — a^rj > 0, J2i=i fi < R- (Let us remind that fi>0 for all i.) 

Description of the maximizers of W gives the following theorem (the proof is a straight- 
forward consequence of Liebig's Law and monotonicity of W). 
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Fig. 14. Optimal distribution of resource for neutralization of factors under Liebig's Law. (a) 
histogram of factors intensity (the compensated parts of factors are highlighted, A; = 3), (b) 
distribution of tensions ijji after adaptation becomes more uniform, (c) the sum of distributed 
resources. For simphcity of the picture, we take here all at = 1. 



Theorem 1. For any objective function W that satisfies conditions [2^) the optimizers 
Ti are defined by the following algorithm. 

(1) Order intensities of factors: fi^ > fi^ > ...fi^. 

(2) Calculate differences Aj = fi — fi _^_^ (take formally Aq = A^+i = 0/ 

(3) Find such k (0 < k < q) thai 

fc / J 1 \ fc+i / i 1 



j=i \p=i 



j=i \p=i 



For R < Ai we put k = 0, for R > Y^jtiJ^j we take k = q. 
(4) If k < q then the optimal amount of resource rj^ is 



A 





E J_ 
p— 1 ap 

if l>k + l . 



(23) 



If k = q then ri = fi for all i. □ 
This optimization is illustrated in Fig. [1 



Hence, if the system satisfies the law of the minimum then the adaptation process makes 
more uniform the tension produced by different factors ipi = fi — avi (Fig. UM . Thus 
adaptation decreases the effect from the limiting factor and hides manifestations of Liebig's 
Law. 

Under the assumption of optimality 0211) the law of the minimum paradox becomes a 
theorem: if Liebig's Law is true then microevolution, ecological succession, phenotype 
modifications and adaptation decrease the role of the limiting factors and bring the tension 
produced by different factors together. 
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The cooper starts to repair Liebig's barrel from the shortest stave and after reparation the 
staves are more uniform, than they were before. This cooper may be microevolution, eco- 
logical succession, phenotype modifications, or adaptation. For the ecological succession 
this effect (Liebig's Law leads to its violation by succession) was described in Ref. [52] . 
For adaptation (and in general settings too) it was demonstrated in Ref. [1]. 

The law of minimum together with the idea of optimality (even without an explicit form 
of the objective function) gives us answers to both question: (i) we know now the optimal 
distribution of resource fl23l) . assigned for neutralization of different factors, and (ii) we 
can choose the function Xk{ipi, ■■■ipq) from several model forms ffTS]) . ffT^ . fl2U]) . 

4-3 Law of the Minimum Inverse Paradox 

The simplest formal example of "anti-Liebig's" organization of interaction between factors 
gives us the following dependence of fitness from two factors: W = — /1/2: each of factors 
is neutral in the absence of another factor, but together they are harmful. This is an 
example of synergy: the whole is greater than the sum of its parts. (For our selection of 
axes direction, "greater" means "more harm".) Let us give the formal definition of the 
synergistic system of factors for the given fitness function W. 

Definition. The system of factors Fi, ...Fq is synergistic, if for any two different vectors 
of their admissible values f = {fi, ...fq) and g = ((71, ...Qq) ff 7^ the value of fitness at 
the average point (f + g)/2 is less, than at the best of points f, g.' 



Liebig's systems of factors violate the synergy inequality ^IM : if at points f, g with the 
same values of fitness W{i) = W{g) different factors are limiting, then at the average 
point the value of both these factors are smaller, and the harm of the limiting factor at 
that point is less, than at both points f, g, i.e. the fitness at the average point is larger. 

The fitness function W for synergistic systems has a property that makes the solution 
of optimization problems much simpler. This proposition follows from the definition of 
convexity and standard facts about convex sets (see, for example, |53j ) 

Proposition 1. The synergy inequality (24^ holds if and only if all the sublevel sets 
{{ I W{i) < a} are strictly convex.O 

(The fitness itself may be a non-convex function.) 

This proposition immediately implies that the synergy inequality is invariant with respect 
to increasing monotonic transformations of W. This invariance with respect to nonlinear 
change of scale is very important, because usually we don't know the values of function 




(24) 



W. 
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Proposition 2. // the synergy inequality [24\ ) holds for a function W , then it holds for 
a function Wq = 6{W), where 6{x) is an arbitrary strictly monotonic function of one 
variable.n 

Already this property allows us to study the problem about optimal distribution of the 
adaptation resource without further knowledge about the fitness function. 

Assume that adaptation should maximize an objective function W{fi — ri,.../g — r^) 
f l2T]) which satisfies the synergy inequality flM|) under conditions > 0, fi — aiVi > 0, 
Ht=i^i < R- (Let us remind that fi > for all i.) Following our previous convention 
about axes directions all factors are harmful and W is monotonically decreasing function 

dW{f,,...f,) 

df^ 

We need also a technical assumption that W is defined on a convex set in M?^ and if it is 
defined for a nonnegative point f , then it is also defined at any nonnegative point g < f 
(this inequality means that gi < fi for alH = 1, ...g). 

The set of possible maximizers is finite. For every group of factors Fj^, ...Fi^^^, (1 < j + 1 < 
q) with the property 

J2 llL < R < J2 llJL (25) 

k=l ^ik k=l ^^k 

we find a distribution of resource rjjj j^.^^ = (rj^, ...rj^_^J: 

r,, = ^ {k = l, ...j) , Ti^^^ =R-j2^ , r, = for {zi, . (26) 

^ik k=l ^^k 

For j = 0, Eq. fl2S]) gives < R < fi^ and there exists only one nonzero component in the 
distribution (!26|) . rj^ = R/ai^. 

We get the following theorem as an application of standard results about extreme points 
of convex sets [53j . 

Theorem 2. Any maximizer for W{fi—ri, ...fq — Tq) under given conditions has the form 
r{n,....,+,} 

If the initial distribution of factors intensities, f = (/i,.../g), is almost uniform and 
all factors are significant then, after adaptation, the distribution of effective tensions, 
if) = {ipi, ...ipq) {ipi = fi — aiTi), is less uniform. Following Theorem 2, some of factors 
may be completely neutralized and one additional factor may be neutralized partially. 
This situation is opposite to adaptation to Liebig's system of factors, where amount of 
significant factors increases and the distribution of tensions becomes more uniform be- 
cause of adaptation. For Liebig's system, adaptation transforms low dimensional picture 
(one limiting factor) into high dimensional one, and we expect the well-adapted systems 
have less correlations than in stress. For synergistic systems, adaptation transforms high 
dimensional picture into low dimensional one (less factors), and our expectations are in- 
verse: we expect the well-adapted systems have more correlations than in stress (this 
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Fig. 15. Typical optimal distribution of resource for neutralization of synergistic factors, (a) 
Factors intensity (the compensated parts of factors are highlighted, j = 2), (b) distribution of 
tensions 'i/'i after adaptation becomes less uniform (compare to Fig. ll4p . (c) the sum of distributed 
resources. For simplicity of the picture, we take here all aj = 1. 

situation is illustrated in Fig. [151 compare to Fig. [Hj). We call this property of adaptation 
to synergistic system of factors the law of the minimum inverse paradox. 

The fitness by itself is a theoretical construction based on the average reproduction co- 
efficient (instant fitness). It is impossible to measure this quantity in time intervals that 
are much shorter than the life length. Hence, to understand which system of factors we 
deal with, Liebig's or synergistic one, we have to compare theoretical consequences of 
their properties. First of all, we can measure results of adaptation, and use for analysis 
properties of optimal adaptation in ensembles of systems for analysis (Fig. [TH Fig. [T5l) . 

There are some evidences about existence of synergistic systems of factors. For exam- 
ple, the aftersurgical rehabilitation of people suffering the lung cancer of the III and IV 
clinical groups was studied |,3J. Dynamics of variance and correlations for them have di- 
rections which are unusual for Liebig's systems: increase of the correlation corresponds 
to decrease of variance. Moreover, analysis of maxima and minima of correlations and 
mortality demonstrates that in this case increase of correlations corresponds to decrease 
of stress. Hence, in Ref. |3] the hypothesis was suggested that in this case some factors 
superlinear increase harmfulness of other factors, and this is the example of a synergistic 
system of factors. 



4-4 Adaptation Dynamics Near a Border of Existence 



We used the idea of adaptation resource to demonstrate how can the models of adaptation 
explain the observable dynamics of correlation and variance under environmental loads. 
Another theoretical approach to explain these effects was proposed in Ref. [M]- The idea 
is quite simple and attractive. Let us represent the population of systems by points in 
a bounded set [/ C with smooth boundary. Coordinates correspond to the internal 
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characteristics of the systems. The whole population is described by a continuous density 
function u{x) in U. 

The hypothetical behaviour of the individual system can be described as a random walk 
in U, and the density dynamics satisfies the correspondent Fokker-Planck equation 

dtu = -{V,bu) + ci^u , (27) 

where a > is a constant diffusion coefficient and b = b{x) is a drift vector. After analysis 
of various optimality conditions, the asymptotic behaviour of solution of Eq. flTTI) was 
studied for b = Abo, bo = const (||&o|| = 1); A —>■ oo, and for no-fiux boundary conditions 
{bu — aWu,v)Qu = (where u is the outer normal to dU). The drift vector b models 
the pressure of environmental factors. For large A, the drift presses the distribution to 
the boundary of U, dimension decreases, and correlations increase. The asymptotics for 
large A is determined by a tangent paraboloid to dU at the point Xb, where the linear 
function {b,x) achieves the maximal value on dU (generically, such a point us unique). 
At this point u = bo. The asymptotic of the solution coincides in the main term with 
exact analytical solution to the Fokker-Planck equation (l27j) with constant coefficients in 
a paraboloid. 

Let us select a rectangular coordinate system with origin at the point Xb, such that in this 
system b = (0, 0, — A) and U is given by the inequality Xg > J^fZi \xf + o . In 

this coordinate system, the solution to the problem is u{x) = vexp with constant 

V. For large A, the variance of a;^, ~ the marginal distribution of xi, ...Xg-i is 
almost Gaussian with af = and these variables are almost independent. We can see 
that the concentration ellipsoid for xi,...Xq-i does not change its form with increase of 

A: the ratio ^ = ^ is independent of A. On the other hand, contraction in direction Xg 

2 

goes faster, and ^ — > as ^Ai (z = 1, ...q - 1). 

i 

To check which mechanism is closer to reality we have to resolve the "disk-or-buUet" 
alternative: How does the correlation increase: (i) the largest eigenvalues of the correlation 
matrix increase and the ellipsoid of concentration becomes stretched-out in small amount 
of dimensions (presumably, in one, that is the bullet form) or (ii) the smallest eigenvalue 
goes fast to zero, and the ellipsoid of concentration becomes flattened out (the disk or 
the pancake form). The existing data ensure us that this alternative should be resolved 
in favor of bullet: under the pressure of environment factors, the small amount of largest 
eigenvalues increases. It is necessary to mention that the variance decreases in the Fokker- 
Planck model near the border of existence, that also contradicts the majority of existing 
observation. 



5 Discussion 

We study a universal effect in ensembles of similar systems under load of similar factors: 
in crisis, typically, correlation increases, and, at the same time, variance (and volatility) 
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increases too. After the crisis achieves its bottom, it can develop into two directions: 
recovering (both correlations and variance decrease) or fatal catastrophe (correlations 
decrease, but variance not). Three results are presented in the paper: 

• Existence of the effect is demonstrated by analysis of many experiments and observation 
of groups of humans, mice, trees, grassy plants, and financial time series; 

• We propose an explanation of the effect through general properties of ensembles of 
similar systems which are adapting to the same or similar environment. A hierarchy of 
models of adaptation is developed; 

• We analyze various types of interaction between environmental factors and prove that 
different organization of this interaction (Liebig's versus synergistic systems) leads to 
different adaptation dynamics. 

What do we know now for sure? In econophysics, as well as in biophysics, a similar phe- 
nomenon is described: under pressure of environmental factors the correlation between 
systems, as well as between attributes, increases and the variance between systems (vari- 
ability), as well as the variance in time (volatility), also increases. 

This typical behavior can be changed when the tension becomes too strong. In that case, 
correlation and variance change in antiphase: when the situation gets worse correlation 
decreases (variance increases), and in recovery the inverse, correlation increases (variance 
decreases). This effect was observed several times, but perhaps needs additional confir- 
mation. 

The case study of the thirty largest companies from British stock market for the period 
2006-2008 supports the main hypothesis. It is also demonstrated that the correlation in 
time (between daily data) also has diagnostic power (as well as the correlation between 
companies has) and connections between days (Figs. [121 [13]) niay clearly indicate and, 
sometimes, predict the chronology of the crisis. 

The principal component analysis demonstrates that the largest eigenvalues of the cor- 
relation matrices increase in crisis and under environmental pressure (before the inverse 
effect "on the other side of crisis" appears) . 

This effect is demonstrated for humans, mice, trees, grassy plants, and financial time 
series. The universality and broadness of confirmations ensure us that for its explanation 
should be found a theoretical idea of the adequate level of generality. 

We propose to look for such an idea in the models of adaptation. The main hypothesis 
now is: the observed effects naturally appear in ensembles of similar systems adapting to 
similar environmental factors. 

We have to stress that we don't consider here interaction between systems. For many 
examples there was no interaction between systems at all, neither one-to-one interaction 
nor mean-field type interaction through the common environment. Sometimes the interac- 
tions exists and may be important for amplification or diminishing the effect intensity, but 
following the empirical data we have to propose the theory which works mainly with indi- 
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vidual difference and can take interaction into account as correction terms. In that sense, 
we do not consider markets as complex adaptive systems [55], but rather as ensembles of 
adaptive individuals. 

Already a system of simple models of adaptation to one factor gives qualitative explanation 
of the effect. 

For interaction of several factors two basic types of organization are considered: Liebig's 
systems and synergistic systems of factors. The adaptation process (as well as phenomod- 
ification, ecological succession, or microevolution) acts differently onto these systems of 
factors and makes Liebig's systems more uniform (instead of systems with limiting factor) 
and synergistic systems less uniform. These theorems give us two paradoxes which explain 
differences observed between artificial (less adapted) systems and natural (well adapted) 
systems. 

Empirically, we expect the appearance of synergistic systems in extremely difficult condi- 
tions, when factors appear that superlinearly amplify the harm from other factors. Some 
data from oncological clinics already support these expectations. 

There may be two programs for development of further research. First of all, the simplest 
system of models of adaptation should be fitted to various data, both economical and 
biophysical. These models could be easily incorporated in the toolboxes of data analysis. 
The classical econometrics [SB] already deals with hidden factors, now we have just to use 
a special nonlinear model of adaptation to these factors. 

Another possible direction is development the models of adaptation. In the present form 
the model of adaptation describes a single action, distribution of adaptation resource. 
We avoid any kinetic modeling because it will introduce more parameters than one can 
find from experiment. Nevertheless, adaptation is a process in time. We have to create 
a system of models with minimal number of parameters. Delay in time is necessary, also 
we have to introduce several levels of resource availability with distinguishing of resource 
and reserve. The processes of resource recovery should be described. Finally, the very 
intriguing question arises: how a phenomenon (or epiphenomenon) of a single resource 
appears, and what are the conditions of its existence and of its dynamical disintegration 
into various particular resources? 
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